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SUMMARY 


OBJECTIVE 

This report is part of an ongoing effort to establish a rigorous, comprehensive tactical 
theory of command, control, and communications (C-^) processes. 

RESULTS 

A formal theory of C-^ processes is presented in conjunction with the evaluation 
through algebraic logic considerations. These take into account linguistic and other nonsto¬ 
chastic information as well as ordinary probabilistic ones. The theory involves a number of 
variables and their relations such as node descriptions, equations of motions, input-output 
signals, weapon firings, etc. As a result of the formal theory, recursive forms are developed for 
the evolution of typical node states as explicit functions of C-^variables and their relations. In 
turn, a game theoretic structure of C-^ processes is also established where moves of the game 
represent the allowable designs of C-Velations. 

In the probability logic case, a general result concerning uniform approximation by 
linear-Gaussian mixoi'^e' of distribution is presented for improving implementations. 

CONCI TSION 

A coherent theory of tactical C-^ processes appears possible through this work. Future 
efforts will address problems of implementation. 
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1. INTRODUCTION 


For the past 10 years, command, control, and communications (C-^), as an organized 
discipline, has evolved greatly from the fledging concepts of J. Lawson, M. Athans, and others 
as presented in the Proceedings of the First MIT ESL-ONR Workshop on Distributed 
Communication and Decision Problems, (Athans, 1978) to the more sophisticated views 
presented in the succeeding Proceedings of the Command and Control Research Symposium 
sponsored by the Joint Directorate of Laboratories (1988). 

In addition to the seminal work presented in the proceedings during the 8 years of 
the MIT ONR workshop on C-^ systems and in the proceedings of the past 2 years of the 
Command and Control Research Symposium, oiner sources for unclassified, unlimited analysis 
of genera! C-^ systems include: 

1. JDL. TPC\ BRG, C^ Handbook (Draft), ,San Diego, CA: NOSC and NPRDC, 
1988. 

2. Institute of Electrical Engineers (!EE), Computing, Control, and Electronics 
Division, Proceedings of the First and Second International Conferences on 
Command, Control, Communications and Management Information Systems, 
Great Britain, 1987, 1988. 

3. Institute of Electrical and Electronics Engineers (IEEE). Special Issue on Infor¬ 
mation Technology for Command and Control. IEEE Trans.Sys.Man. Cybern., 
Vol SMC-I6(6). Nov - Dec 1986. 

4. Armed Forces Communications and Electronics Association (AFCEA). Science 
of Command and Control; Coping with Uncertainty. Fairfax. VA.: AFCEA 
International Press. 1988. 

5. R. Sweet. M. Metersky. and M. Sovereign, eds.. Command and Control Evalua¬ 
tion Workshop (Proceedings). Based on Military Operations Research Society 
(MORS) MOE Workshop, Jan 1985. Naval Postgraduate School. MORS and 
MITRE Corp., Nov 1985, 

6. C. Strack. Elements of C^ Theory, McLean. VA.: Defense Systems Inc. (DSI), 
draft version. 15 Oct 1985, abridged version. 30 Jan 1985. 

7. Office of the Secretary of Defense and MITRE Corp.. C’ Division. Proceedings 
for Quantitative As.sessment of Utility of Command and Control Systems, 
proceedings of conference held at National Defense University (NDU), Ft. 
McNair. Washington, DC, Oct 1979, McLean. VA.: MITRE Corp., Jan 1980. 

For an overview of the more important papers from the MIT, ONR workshop on C-^ 
up to 1985. see Goodman (1985). More recently. Van Trees (1988) has presented an excellent 
critical analysis of the state-of-the-art in C^ work. Based on these studies of C^ systems, we can 
conclude that past and current work m this area can be divided roughly into the following 
taxonomy: 

1. C ’ systems on long-range strategies, global and political ramifications, and high- 
level planning. 

2. Tactical or midievel C’ systems, emphasizing the actual dynamics of C-^ events 
during typical engagements. Note: throughout this report, little or no distinction 
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is made between the use of the terms “systems” and “processes.” nor between 
“measures of effectiveness” (MOEs) and “measures of performance” (MOPs). 
However, for a different viewpoint, see Metersky (1985). 

a. Qualitative studies, emphasizing th<* use of graphs, flowcharts, and verbal 
descriptions. 

b. Quantitative studies, emphasizing numerical measures or algebraic relations, 
usually centered about the stochastic state space approach. 

(1) Aspect-oriented quantitative work, where one, or possibly more, 
particular facets of tactical C-^ processes are considered. Typical exam¬ 
ples of this are surveillance and tracking/correlation, tactics fora 
particular class of scenarios, deployment for air-to-ground conflicts, 
determination of MOEs for C-^ systems, resource allocation of troops 
or weapons studies, communications analysis. C-^ decision aids, aspects 
of distributive decision-making, and game theory applied to restricted 
situations. 

(2) General-structured analysis, where an attempt is made toward 
developing a general view of C-^ processes as a whole entity. 

3. Technological hardware/software considerations, database management, com¬ 
puter design, field exercise studies, teaching and training of C-^ concepts. 

Suffice it to say, the vast majority of endeavor in C- analysis has been directed to 
subparagraphs 2a, 2b(l), and 3. with little attention paid to 1 (understandable relative to the 
open literature format) and 2b(2). Certainly, qualitative studies are still useful due not only to 
the inherently great complexity of C-^ systems, but also since heuristic analysis must always 
precede any quantitative analysis. Furthermore, quantitative aspect-oriented work is also of 
prime importance, since the various parts of the whole C-^ picture are in themselves challenging 
and complex problems. Understanding the bits and pieces of can only contribute to the 
entire view. Nevertheless, we contend that more effort must be made to discern the general 
pattern of C-^ dynamics if C-' work is to gain the stature of other scientific disciplines. 

For some attempts at considering C-’ tactical processes as a whole entity, see e.g., the 
independent works of Ingber (1986) and Rubin and Mayk (1985). as well as followup papers 
by these authors in the proceedings of the MIT/ONR workshop on C-^ systems and later 
proceedings. Ingber’s approach to the problem is a mesoscopic-macroscopic one, considering 
systems analogous to systems of interacting molecules or neurons, suitably modified and 
analyzable from a statistical mechanics viewpoint. On the other hand, Rubin and Mayk’s 
approach is more microscopic in nature, also utilizing a purely stochastic technique, originally 
centering about numerical supply and attrition levels, generalizing the well-known Lanchester 
equations for mutual growth and decay of interacting populations. Although the thrust of their 
work has greatly expanded, modeiiiig of the internal behavior of node complexes of 
decision-makers is not explicitly taken into account, as Levis (1983) and Tomovic and Levis 
(1984) have done. In the latter, the behavior of individual decision-makers and their constraints 
and interactions with ttthers are modeled from an organizational viewpoint, using in one key 
part Conant's decomposition of entropy, as well as other criteria. (See also the subsequent 
papers by I evis and his students at the Laboratory for Information and Decision Systems 
(LIDS). MIT in these proceedings and those of the MIT ONR workshop on systems.) 
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With modest changes, we can attempt to model the entire tactical process, using 
individual node structures and states as the basic building blocks, without necessarily making 
stochastic assumptions. This author has proposed such an approach. (Goodman, 1986a) with a 
followup paper (Goodman, 1987) elaborating upon the use of nonprobabilistic models in C-^ 
analysis. Much of this was based on previous work conc'rning the modeling and combining 
of uncertainties arriving from possibly disparate sources, .stochastic or linguistic (Goodman and 
Nguyen. 1985). [.See also Goodman, (1986b) for a practical implementation of such an 
approach for tracking and correlation of data.] 


2. SCOPE OF THE PRESENT WORK 

The current task is an impro\ement and enlargement of the previous efforts in estab¬ 
lishing an ocerall model ibr dc namic's (Goodman, 1986a, 1987). The basic goal of this 
report is twotold: 

1. T o show that tactical processes can be modeled within a game theor\ setting, 
using a formal system of a.xioms. capturing a minimally required number of rela¬ 
tions among C-^ \ariables and operators. 

2. To provide an outline for a feasible implementation of this program as an aid in 
designing and predicting global behavior of sy.stems. 

In modeling the C-^ processes, we must tradeoff the fidelity of a theory with the 
complexity of resulting computations required for implementation. The thesis here is that we 
should first attempt to model C-^ processes as a whole, despite its complexities, then seek 
reasonable reductions of computations. 

In section 3, the basic C-' model is developed as a decision game. This requires five 

steps: 

1. Select a set of axioms involving relevant C-' variables and operators so that a 
formal description of dynamically evolving node states can be obtained. 

2. Select an algebraic logic description pair to numerically evaluate the formal 
ttn-wi V developed lit ^icp I. 

3. Specify an aseraging procedure that can apply to all C' node state evaluations in 
step 2. 

4. Tse outputs of step 3 to determine the oserall “state of health” (i.e,, tendency for 
winning' of each system. 

5 T'se figures of merit (TOM) in step 4 to define the overall loss lunction, ana 
hence, C ’ decision game. 

As in prc\ ious work. processes here arc viewed as interacting networks of node 
complexes of dccisit'n-makers. Relevant C’ variables are first identified, including nodal ones 
such as equations of motion, attrition level, detection state, algorithm selection, and hypi'theses 
e\aluations. Other C'^ variables treated are reception of signals or incoming exploding weap¬ 
ons. and the responses following data processing. In addition, logical operators, such as 
con|unction. disjunction, negation, and conditioning operators among C-’ variables are also 
taken int<' ai count. 






f o implement step I. a collection of axioms is presented in section 4, formally repro¬ 
ducing il'.c cs:;wntial relatiu.iS among variables and operators. These axioms modify and 
extend analogous axioms presented by Goodman (1986a). These axioms reflect the typical time 
cycle of a node, somewhat simplified. They begin with the reception of arriving “signals” (i.e., 
information, weapons, any other incoming entities which can provoke change in the node state) 
followed by information processing and related activity. These axioms end with the time of 
output response by the node to other nodes, friendly or adversary. With the formal language 
established through the axioms and using the standard rules of deduction, a basic theorem is 
derived. I heorem 4.1 gives a formal description of the dynamic evolution of a typical node 
state vector at the end of the input-output cycle as a functional of the same node state at the 
beginning of ihi- cycle just prior to the reception of the “signaT'and of all other pertinent 
C'^ variables. 1 his immediately leads to a recursive form for each node state's evolution, begin¬ 
ning with the original intitiali/ation of the system. 

In step 2, an algebraic logic description pair (ALDP) is chosen, compatible with the 
above formal descriptions, in order to obtain the full quantitative evaluation. Typically, proba¬ 
bility logic can play this role, but in order to utilize linguistic-based and other types of informa¬ 
tion, other logics can be used just as well, such as Zadeh's fuzzy logic or Dempsler-Shafer's 
belief logic. A scheme is presented for using the.se logics in a oiboptimal or marginal sense as 
inputs to "two-person" (actually friendly versus adversary C-^ processes) decision game. For 
more details on steps 3 to 5. see the concluding part of section 3. 

By choosing probability logic for implementation, a fundamental result (corollary 5.2) 
can be invoked that is of potentially good use in evaluating the overall dynamic evolution of 
C'^ node states. Section 5 presents the details of this logic where essentially, a uniform close 
approximation by finite linear-Gaussian mixtures of distributions can be used to represent 
distributions of variables and in turn, the evolving node states. 

Finally, section 6 presents a brief dfscussion for application of the model, in general, 
and to a simplified inner-outer air battle scenario, in particular. 


3. THE DECISION GAME 

In all that follows, for simplicity, we will consider only two C-^ proce'^ves. one friendly 
and one adversary. 

Titer? are three types of variables describing a process: 

M. node complex variables, representing the decision-makers, human or automated, 
and their immediate environment. 

S, input "signal" variables, where, as explained before, “signal" need not refer to 
iust an ordinary array of incoming information, but may, as well, dein/iv incoming uct:vr*“d 
weapons or other disturbances to the initial node complex, 

R. node output responses immediately following the complete “signal” processing. 

Svmbolically. one can represent the temporal relation among M.S.R, as 

. . . - M - R - S - M - R - S - M - R - S, (3.1) 

regardless of the particular nodes interacting with other nodes and the multiplicity of “signals" 
and responses. In general, an arriving “signal" originates, nossiblv from several, nodes M as 
initial responses R, but due to intermediate media distortion and change, becomes S. .See 
figure I for an example of a process, showing how one can scope out the roles of “signals", 
responses, and nodes. 
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Rp'ipiinsM vV*\ip;)n 



Adversary C"^ Side 


Figure 1. S.inplified ••xte.ual dynamics of processes, 

\ anablcs. M.S.R can be mde.xcd. sub or super, to indicate the particular process, 
tnemlls or adsetsats. the specific node involved, and the time. Node \ari;ihles can be decom¬ 
posed inti' two parts, with simihtr remarks holding lor inde.vmg ol these ami all subsequent 
decompositions of the main variables into subvariables: 

\1 - iN . 1 ) (.V2) 

where N lepresents the nmU’ state, while 1 represents the internal node sirneinre. See figure 2 
tor an illustration ot a tvpical node structure (relative to the processing of incoming "signals"). 
See ficiire (or the btf.ic evolution cvcie due to the processing of a "signal" as in figure 2. Note 
the’superscripts ( ) .( )' to indicate relative times and (Si R ) to mdiciite conr/dion/ng, f-or 
simplicitv. ehanges .ire onlv noteel at times ol response and times ot reception, following 
medium distortion ot responses 

I vpicallv. node states involve; threat levels; numbers ol troops; numbers of weapims ot 
ilii'erent ivpcs; supplv levels, equtiiions ol motion ol the node il not stationarv. such as a tank 
or a toimation ol airpl.ines. or il stationarv but its locatuuis is in lioubt: as well ;is possible 
s iiiiwiedge ol estimates ol other node states. Iriendiv or adversarv. See table 1 lor a simple 

'■sample Sv mbolieallv. one can write N and I in subvariable form such as 

N (.'U [’, aU [»,. .eW f’,. a f ROOIk rQMO. INK)| . (,f ?) 

I I 1)1 I . \1 (i. HYP. \ 1 S. (ONS. DK. ) , (.Y4) 

wheat’ itie above s\mho|s aie essentuillv selt-e.\plan;itoiv. such ;is: - number of tvpe 2 

w ’.ipoiis oiihoard. f (JMO ~ ee|u;itions o| motion (ol entire mule); INf’O = knowledge or esti- 
mai'.’s ol itihe' mule -tates; HI 1 - detection state (usiiallv 0 or I. ioi probabilistic inierpteta- 
;ionsi. \| (r .ilyoiithms chosen tor possible response: I I S = data liision vtiriables, further 
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Figure 2. Simplified interna: dynamics of processes. 
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Figure 3. Basic evolution cycle of a node doe to "signal" processing ann response. 
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Table I Conipt)nents of C’ node states. 


r N 




r ■>! 
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Node 
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importance 

State 
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Supply Eevel 





Eq. of Mo, 





Damage f.evel 

Vector 


Knowledge 


Estimates of 



Part 


Other Node 





States 

v d 


L J 


V J 


NODL = (NODE STATE. NODE .SI RECTURE) 

decomposable into appropriate subvariables, when required, sucli as in correlaiion of data in 
rr.ultitarget tracking; and DEC = decision variables representing actual decisions to be made 
based upon arriving "signals”. 

Consider now the basic C-^ structuic indicated in equations (ivl) through (.’^.4). as well 
as time-shift markers ( ) .()*,{ and conditioning operator ( |). Also, note logical connectors 
& (conjunction and intersection), v (disjunction or union). ( j'(negation not complement) 
and set event relations DOM (domain of possible values of the associated variable), e (set 
rnembersnip relation). Q (universal set of discourse) and (p (null or empty set). Clearly, any 
qualitative or quantitative description of a C-’ process as a whole entity must entail descriptions 
of the nodes constituting the process using, in some sense, the above concepts. 

With all of the above C^ variables and operations noted and interpreted, the funda¬ 
mental steps in establishing an overall model of tactical processes can now be attempted: 

(1) Obtain a tormal theory for the dynamic evolution of a typical node state N using 
an appropriate set oi a.xiom'- AX involving C-' variables and operators. In this case. N can be 
e.xpressed as some func io lal of C^ variables and operators symbolically described as 

N::7(A\). (.T5) 

Details of these relations are given in table 2. in section 4. 

(2) Evaluate quantify typical C^ node states as given in eq. (.T.'v) by choice of some 
algebraic logic description pair (ATDP). Such a pair consists of a syntax space with algebraic 
structure and a compatible semantic evaluation logic (unction with range in the positive real 


line Examples include; 

f'[.(classical logic) - (Boolean algebra. 0-1 truth (unction) . (. .6) 

PI (probabilitv logic) = (Boolean algebra, probtibility metisure) . (.1.7) 

fT,(Zadeh’s (u//v logic) = (Browerian lattice possibility (unction) . (.T8) 

DSBl (Dempstcr-Shaler belief logic) = (Boolean algebrti.. bcliel lunclion) . (.^.9) 

[See (joodnian ( 1987) anti fioodman & Nguyen ( 198 ,*!) (or lurther details.] 
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Indeed, one can view the ALDP evaluation as the final part of knowledge flow in 
describing not only processes, but also of situations in general, beginning with cognition. 
(See figure 4 for a brief outline of this.) 


Qualitative Phase 


Problem Situation _^ Cognition _^ Natural Language 

(C^ Processes) Formulation 


Quantitative Phase 

Algebraic Logic Full 

Description Pair: - Formal Language/ 4-- Strings of Syrnbols, 

(Syntax, Semantics) Formal Theory Dictionaries 



Figure 4. Knowledge flow in describing situations. 

Denote the numerical evaluation of each formal node state description symbolically as 

P.ALDpf^'-C-^) = I l(N.C'’)| 1 aldp - (3.10) 

where Pai.dp O'" 11 II ALDP indicates the logic function associated with the chosen ALDP. 
Thus, for pi, Pai.dp tneans a probability measure (or function, etc ), or if one chooses ALDP = 
FL, ppi = poss, a possibility function, etc. For an ALDP, in general, call Paldp ^ dispersion, 
unless otherwise specified. 

Using eq. (3.5) in eq. (3.10) and applying the compatibility property of ALDPs yields 
the relation 


PAI.DPi^-C^) ■ ’^AI.DP.Ax[PALDP^'^i^'C‘^)] • I) 

where N is a given node state of a process, denoted simply as C^, f?ALDP AX ® functional 
and Pai.dpI AX.C-^), extending somewhat the notation in eq. (3.10), is the collection of all 
dispersions in evaluating the RHS (right-hand side) of eq. (3.10) for a given C-^ process 
(friendly or advc-rsary) and choice of ALDP. Note that in a real-world situation, for given AX 
and ALDP, the set of dispersions Pai Qpf AX,C^) is highly dependent in form upon just what 
is, or equivalently, any allowable collection of dispersions represented by Paldp^'^^'^^) 
completely determines and thus, may be identified with any of its primitive set of disper¬ 
sions determining all of C^. 

In the approach in steps (I) and (2). each node is considered separately or margin- 
allv taking into account, however, all of the nodes that interact with if as well as all relevant 
variables, friendly or adversary. This is assumed at the outset in order to obtain a simpler 
model than if all possible joint interactions at a given time were taken into account, analogous 
to the suboptimal determination of individual marginal distributions of a more (exponentially) 
complex joint distribution from which the marginals arise. 

(3) In turn, combine the results of step (2) individual updated marginal node state 
descriptions back into a simple global description of the C-^ process at hand. As mentioned 
above, this is done considering the very real tradeoff of model fidelity versus complexity of 
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calculations, in place of attempting to carry out the optimal full joint descripton of behav¬ 
ior. A reasonable combination operator AV here can be simple arithmetic, or more generally, a 
weighted sum. averaging the corresponding node state entry dispersions. repre.senting thus an 
updated overall process behavior. If arithmetic averaging is not desired, other suitable 
measures of central tendency can be used, such as modes or medians, among others. The basic 
output at this stage can be symbolized as 

Pai DP(C^) = AV(p^-^i pp(N.C^). all N e C''). (3.12) 

where C-^ represents the particular C-^ process of interest. 

(4) Next, determine a functional H p)j> which directly relates the updated averaged 
dispersions of a given C-’ process with a single or multiple attribute vector describing the over¬ 
all “health" state ot . 

HI. FH [)p(C-^) = ^ai.dp[(Pai ■ (3.13) 


For example. DP could be a certain weighted mean, or perhaps involve set thresholds, 
of a number of MOF.s and or MOPs of the process as a whole, each of which, in turn, 
depends upon Paldp(C^) Examples of such MOEs and MOPs can include overall supply 
attrition level, overall entropy level, various system performance criteria, including timeliness, 
damage levels, kills, destruction of enemy level, etc. For a good systematic exposition on 
MOEs and MOPs and related measures, see Sweet (1987) or Rubin and Mayk's discussion 
(1987 pp. 15-16). 

Using eqs. (3.11) and (3.12) in (3.13) yields 


Qp(C-’) - ■?ALDP[PAI.DP^'^^’C’^1 ' 


(3.14) 


for some functional 3 depending in part on <S, H. 

(5) Finally, one can establish the desired two-person zero sum decision game F as 
shown schematically in figure 5: 

The loss function in figure 5 resulting from the moves of each player can be expressed as 
I OSS = ^Al.Dp[HETH^, np(C^\), HLTH^. opfCAd)] 

- ^Al Dp[PAl Dp(^^-^Fr)- PaI Dp()] , (3.15) 


w here K is determined by equations (3.11) through (3.14). 

Thus, one can inquire whether I’ has a game value, what the Bayes strategies are for 
ea>.ii side, what the least favorable move or .strategy is for the adversary versus the friendly side, 
what the friendly side's minimax strategy is. and what the class of admissible strategies is for 
each side. etc. All answers must depend upon the allowable clas.ses of choices for the primitive 
relations p^[ pp(AX.C-^). 

Such a game can be of value in the design and study of sensitivity of outcomes for 
processes, provided these questions can be addre,s.scd using feasible computations. This of 
course, depends on whether eq. (3.5) and hence cq. (3.11) can be effectively limited in 
complexity. 
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Nature = Adversary Process 

Decision-maker = 



\ =C^ 

Friendly Process 

\ Ad 

= C3 

\ Typical Move: Choice of 

Typical Move: 

PALDP^^-^Ad^ 

Choice of 

1 

1 

PaLDP^^^'^ Fr^ - — 

▼ 

Loss 


Loss is determined through a functional ^^ldp S®® equation (3.15) below. 

Figure 5. Schematic for decision game F. 

A summary of steps 11) through (5) is given below in figure 6: 

In the next section, a key part of the development of F is given as the choice of axioms 
AX and the resulting formal structure for node state evaluation as in step (1). 



Figure 6. Functional development of decision game F. 
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4. FORMAL THEORY AND EVALUATION FOR THE EVOLUTION 
OF A TYPICAL NODE STATE 

In the past, a number of attempts have been made to develop formal theories for 
various scientific and social disciplines which traditionally had not been analyzed from such 
viewpoints. See, e.g., Woodger (1987) for biological systems and Carnap (1958), for other 
applications including legal and social considerations. In this report, a simplified list of axioms 
in non-quantifier propositional form is proposed, characterizing the essential features required 
to evaluate dynamically evolving C-^ node states. In turn, as oulined in section 3, these axioms 
can be of use in developing a C-^ decision game. These axioms are of three kinds: logical 
connections, properties of conditioning, and reduction of relations among C-^ variables, or 
sufficiency conditions. The axiom collection AX is summarized in table 2 as follows; 

Table 2. Formal language description of a C-^ node evolution. 

Equality Symbol; = 

Constants; fl, (t> 

Dummy Variables: a, /?, y 

Specific Variables: N, R. S, T 

N and T can be partitioned into subvectors, e.g., 

N = (#WP|, ftWPj, ffWPj, #TROOP, EQMO, INFO) 

T = (DET, ALG, HYP, FUS, CONS, DEC) 

Operators: ( )*, ( )'. ( )q, (|), &, v, DOM, e 
General Axioms: For all a. p. y. and for ★ = &.v: 

Ring structure for &,v 

a*P = pita. a*(Pity) - (a*p)*y , 
a&di = <t>. a&n - a - a\(i>. avfl = fl, 
a&(P\y) - (a&PMa&y) . 

General Axioms: For all a, p. y. and for ♦ = &,v: 

Implicative Conditional structure for &,v: 

(alfl) = a, {a\P) = {a&P\P) . 

(a&.p\y) = (tt|)3&7)&Ol7) • 

(a*P\y) - (al7)*(/3|7) , 

Vo = fl . 

atDOM(a) 

Sufficiency Axioms: For N = (N&N &N'“&. .ANq): 

(N-*1R"'&T' & N* & S & R & N)= (N*‘|R"* & N") , 

(R*‘(T' & N* & S & R & N) = (R*‘|0EC" & N") . 

( TIN* &S & R &N)=(T‘|ND 

(N*|S & R & N) = (N'MS & N) , 

(S|R &N) = (S|R ) , 

(R I N)=(R IN) 


II 







1 he ring structure axioms are the minimum needed to characterize conjunction and disjunc¬ 
tion. (Note that no inverses are postulated.) The axioms for conditioning, while reflecting well- 
known properties, such as for probability interpretations, are new in that they refer to measure- 
free conditioning (see discussion later in this section). The sufficiency axioms show the relation¬ 
ships among the C' variables of interest, based on sequence of events as outlined in figures 2 
and .T 

The axiom set in table 2 leads to a particular form of equation (3.5) describing recur¬ 
sively node state evolution: 


Theorem 4.1. 

Under the assumptions in table 2; 

(i) 

= V [(N*" i & T" & N* & S & R & I^)& 

(R"^ &T" & N" &S& R &I^)] 
R*%DOM(R"n, 

T^nOM(T*). .SeDOMlS). 

N%DOM(Nn. R €D0M(R ), 

?veDOM(S) 

= V [(N""| R"" & N")&(R^"|DEC* & N")&(T"| N^) 
&(N^|S & N)&(S| R )&(R |N)&N] 

" R""eDOM(R**). T*tDOM(T"), 

_ N%DOM(N*). SrDOM(S). R <DOM(R ). NeDOM(N) 

(ii) Regrouping terms above, compatible with table 2; 

N"" = V f(N"-^|N) & N] . 

Nf r)OM(N) 

(N^*|N)= V [{N^^|R"*&N")&(R**|N")&(N"|N)] 

R*’r IX)M(R"*)1 

N’ f DOMIN') _ . 

where 


(4.1) 


(4.2) 

(4.3) 


(N’|N')= V [(N'lR &N)&(R |N)1, 

R f[X)M(R ) 


(4.4) 
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[(R*MI^EC^& N*)&(T"|N*)] , 


(4.5) 


(R""|N")= V 

I "t DOM( r *) 

(N"|R &N)= V [(NMS&N)&(S|R )]. 

Se DOM(S) 


(4.6) 


{T*|N*) = (DEC*|CONS^&FlJS^&HYP*&ALG^&DET^&N^) 

&(CONS^|Fl)S"&HYP"&ALG*&DET"&N") 

&(Fl]S"| HYP"&AEG^&DET^&N^) 

&{HYPMAI.G"&DET"&N") 

&(ALG^lDET^&N*)&(DE'r|N^) . (4.7) 

Proof'. Details omitted, but straightforward application of the usual rules of substitution and 
the a.xioms in table 2. 


Table 3 presents interpretations of the formal language used in table 2 for presenting 
the axioms and consequent structure of node state evolution in theorem 4.1. 

Table 3. Interpretations of the formal language for node evolution. 

N = Node state vector. T = Node structure 
R = Response vector, S = "Signal” vector 
( )* = Positive time shift to new phase 

( ) = Negative time shift to old phase 

( ),| = Initialization of state (time-wise) 

(I) - Implication or conditioning 

& = AND. V = OR. ( )' = NOT (explained earlier) 

DOM = Domain of possible values 

e = Set membership relation as used before 

(t> = Null set 

fl = Universal set 


Thus, using the interpretation in table 2, compatible with figure 3. 

( R*^* I I ) = response following processing. (4.8) 

(N"^*! R**&N'’) = new node state due to its sending out response , (4.9) 

(r*|N*)= processing data, (4.10) 

(N I N) = full cycle of node change due to “signals” received, over all 

possible processing, and responses, etc. (4.11) 
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Following the five-step procedure presented in section 3 for developing the overall 
decision game, the next stage requires the numerical evaluation of given in theorem 4.1 
through choice of a suitable ALDP. 


Remark 4.1 

Note that one can readily verify that all Boolean algebras — and more generally, all 
Browerian lattices - to .satisfy the axioms in table 2. Hence, all four examples of ALDPs given 
in equations (3.6) through (3.9) can be used to evaluate theorem 4.1. For background and 
discussions in considering the most appropriate ALDP for a given situation, see Goodman and 
Nguyen (1985, Thus, if PI were chosen as the ALDP by assuming only stochastic rela¬ 

tions should be used, then eq. (4.3) becomes 

p(N^*|N)= / p(N*-^|R*NN^)*p(R""|N*)p(N^|N)dR^^dN^ (4.12) 

over all 

R*^DOM(R""). 

N*€D0M(N") 

yielding, in turn, the counterpart of (4.2) 

p(N*")= / p(N""|N)-p(N)dN . (4.13) 

NTDOMlN) 

Or. if FL were chosen as the ALDP. by assuming only fuzzy relations should be used, 
then eq. (4.3) becomes 

poss(N""|N) = max(min[poss(N**|R*TNn.poss(R^*lN+)poss(N"lN)]} (4.14) 
over all 

R"NDOM(R*0 , 

NNDOM(N^) 

yielding, in turn, the counterpart of eq. (4.2) 

poss(N^"^)= maxjmin[poss(N**|N),poss(N)]} . (4.15) 

NtDOM(N) 

One could also choose combinations of PL and FL or other ALDPs. Again, see Goodman 
(1987). 

Similarly, by applying, e.g., PL, one can evaluate in turn 

p(\^j\)= / p(5rlR ,N).p(R |N)dR (4.16) 

R tDOlVKR ) 

p(R‘MN’)= f p(R^*|DECNNO.P(TMNr)dT^ (4.17) 

rNDOMdO 
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(4.18) 


p(N^|R ,N)= / p(N"|S,N).p(S|R )dS 

SeDOM(S) 

P(S!R )= p[W = S f(R )], (4.19) 

when the nonlinear additive regression relation holds 

S = f(R ) + W . (4.20) 

where W is a random vector representing additive medium error between responses and 
"signals" and f is a known function representing medium distortion. 

Thus, one can identify the probabilities in equations (4.12). (4.13), and (4.16) through 
(4.i9) with ppi (AX.C-^) as given in step (2), following equation (3.11). Hence, by specifying 
Ppi (AX.C^) for each process, friendly or adversary, one can then proceed, at least in theory, 
with the construction of the decision game, as outlined in steps (3) through (5), section 3. 
Similar remarks hold true for the use of FL or any other of the ALDPs. 

■ 

In particular, for PL, it follows from theorem 4.1 that for each process. Ppp (AX.C^) 
is determined by first specifying 12 relatively primitive relations. Thus, one can write; 

p(N**lR^^N"), 
p(R"|DEC".N"), 

p(DEC"|CONS^FUS^HYP^ALG^DET^N^), 
p(CONS*|FUS^HYP^ALG^DET^N*). 
p(FUS^|HYP^ALG^DET^N^). 

p(HYP"lALG^DET^N*). 
p(ALG*|DETTN*), 

p( DETAIN"), 
p(N*|S.N), 

P(S|R ), 

P(R |N), 

P(No) 

Of course, it is understood in eq. (4.21) that the relations (except for the last) must be 
specified for each time cycle of node-processing input “signal" to output response. 

In another direction, noting that many of the relations in table 2 and in subsequent 
equations are in conditional form, it is of some interest to inquire whether this theory can treat 
operations on conditional forms when the antecedents need not be identical, generalizing the 
axiom in table 2 

(a*l3\y) - {a\y)*(P\y) (4.22) 

to the case 

(a/*0\p) - {a\y)*{/3\r]) . (4.23) 
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where now r] and 7 need not be the same, and p is some computable function (another event 
or set) of a.P^y.T], for ★ = &,v. For example, one may wish to determine Q, and by choosing 
PL, p(Q), some appropriate joint probability measure p, where 


Q = [(a|b)&(c|d)]v(e|f), 


(4.24) 


where 


a = a(x) 
b = b(y) 
c = c(z) 
d = d(r.s) 

e = e(w) 

f= f(q) 


enemy will move up about x troops tomorrow; x = 0, 50, 100, 150. 

it will y tomorrow; y = be clear, snow, rain. 

enemy will use pass z to approach us; z = 1, 11, HI, IV. 

morale of enemy node 17 is at level r and number of their troops left is s ; 
r = very low, low, medium, high, very high, s = 0, 100, 200, 300. 

enemy will w tomorrow; w = surrender, not surrender, 
enemy overall damage level is q ; q = 0 , 1 , 2 ,..., 10 . 


Of course, if the antecedents in eq. (4.24) were all the same, then no real problem 
w ould arise, since it is readily Justified that for any choice of ALDP — certainly for PL ! 

— ulut 


Q = [(a|d) & (c|d)] v (e|d) 

= {[(a&c)ve]|d} , (4.25) 

even though normally one does not talk about such measure-free '*ntities (up to now). Indeed, 
since the goal is the evaluation of Q, for PL, choosing a probability measure p over all the rele¬ 
vant events, one would usually evaluate Q as simply 

P(Q) = p{[(aid) & (c|d)] V (e|d)} 

= p{[(a&c)ve]|d} 

= p{[(a&c)ve] &d)/ p(d) , (4.26) 

etc,, assuming p(d)> 0 . 

But the point of the above example given in eq. (4.24^ is that the antecedents in the 
conditional forms are not identical! What to do? 

Contrary to popular belief (author’s note: this author and his colleague Prof. H.T. 
Nguyen, Mathematics Department New Mexico State University, Las Cruces, have undertaken 
and extensive informal survey of the probability community — both applied and theoretical — 
resulting in the following conclusions — see Goodman (1988) and Goodman and Nguyen 
(1989): there is no systematic and mathematically sound procedure for computing p(Q) (or Q, 
for that matter) in eq. (4.24) or. in fact, for any similar problem! 

Indeed, there are “folk” remedies to this situation which reduce to either identifying 
conditioning with material implication, forcing conditioning to be a closed operation over the 
Boolean algebra of events, or identifying conditional events as marginal to a universal joint 
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event having a fixed antecedent common to these marginal ones. In either case, serious difficul¬ 
ties arise, either mathematically or computationally. For a satisfactory solution to this problem, 
see Goodman (1988) and Goodman & Nguyen (1989), where a sound and complete ALDP 
(among other properties) is developed, compatible with and extending, classical PL, called 
CPL (conditional probability logic). 

One consequence of the calculus of operations in CPL is that the evaluation of Q in 
eq. (4.24) becomes 

0 = (a|/3). (4.27) 

resulting in the value 

p(Q) = p(a) p(/3) , (4.28) 


where 


a - (a&b&c&d)v(e&0 . (4.29) 

/? - a V {[(a'&b)v(c'&d)v(b&d)]&f} . (4.30) 

differing considerably from the “folk” approaches. 

Returning to the construction of the C-^ decision game, again note that by utilizing the 
evaluations as in equations (4.12). (4.13), and (4.16) through (4.19) for PL. or equations (4.14), 
and (4.15). and analogous calculations for FL. etc., one can then recursively evaluate the 
dispersion of N"’ in eq. (4.1), However, as gleaned from figure 7 below, regardless of the ALDP 
chosen, even the basic scheme for evaluating a typical single node-processing cycle from input 
to output without further decomposition of the C-^ variables and subvariables, especially that 
of T* and N*. still requires on the order of q^ matrix vector addition or multiplication opera¬ 
tions, when, for simplicity, the domains of possible values for N.R.S.T have the same cardinal¬ 
ity q. Under the same assumptions, one must also store about 2 • q3 domain values in order to 
accomplish all the computations. 

The evaluation procedure can become extremely tedious due to the multiplicative 
forms of the terms used, compounded by lengthy iterative disjunction operations over the 
domains of the variables. In the next section, a possible solution to this problem is offered for 
the case of PL. 
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5. I TILIZATION OF LINEAR-GAl SSIAN MIXTURE APPROXIMATIONS 


As stated bef ore, all modeling of processes, in general, must take into account the 
very real problem of accuracy of model versus complexity of calculations. On po.ssible reason¬ 
able solution to this diffieulty, at least for the choice of ALDP = PI., involves the use of some 
fundamental approxi.mation and representation theorems, which arc useful in their own right. 

First, before considering a theorem based in part on material in Goodman and Boyer 
(1975). the following definitions and notational conventions will be introduced; 

I etting r be an\ positive integer and 'K^ the real r-dimensional Euclidean space, with 
[0,1] being the real unit interval, call any cumulative probability distribution function (cdf) 
f —[0.1] well-hehaveci U\ in its Jordan-1 ebesque decomposition (see. e g,. Feller. 1966. 
pp I.F'' 140) no singular component appears, the discrete component distribution, if present is 
at most finite, and the absolutely continuous component admits a probability density function 
(pdfl which IS bounded and uniformlv continuous overT^F Thus, 

F^aF'I'mI A)-F'-'. (5.1) 

where 1 -*[(),I ] corresponds to a linitelv discrete probability measure for j = I and an 

absolutelv continuous probabilitv measure lor j = 2, with pdf F-* being bounded and uniformly 
continuous over 7?' 

C'learlv. large classes o! common probability measures have edfs satisfying these 

criteria 

f or notational purposes, also let 

f ''' ^ p,‘6c ) , (5,2) 

u,l 

vvheie /a, t 7c' is a mass point lor F'6 is the diiac delta lunction. p, represents the probabil¬ 
itv ot occurrence relaiive to l at yU| , 0<p,sl . |t,l . ^p, = I , 

k.l' 

.1 being tmite or even vacuous Hv convention, it ,1 = <5, is vacuous, and F reduces to the 
purelv absolutelv continuous cdl F'-'. 

Depenvling on the contexi used, denote g\ lo mean either the pdt. cdl, or probability 
distribution, corresponding to an r-dimensional (laiissian ilistribution with mean (),. and posi¬ 
tive detmite covariance matrix 1. Next, tor anv sequences 

r ^tr,....r,^) , ^ ^ ( m ) • • • -Mn,) ■ 1il . (5.3) 

O', r,' I . - I , noting the pdl for g\ is 

gxix) = ((2~)' • determ(l)] ' •e ' '-s' ( 5 . 4 ) 

lor all X f , so that g\(' gil corresponds to an r-dimensional Gaussian distribution with 
mean n and covariance matrix 1. let the finite (iaussian mixture 
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g, 1 = ^ M-gv^ (• M;) - (5 5) 

1=1 

u hlci; can represent a pdf', cdf, or probability distribution, depending on the context. 

With all ot the abo\e established, a uniform appro.ximation theorem can now be 

stated. 

Theorem 5.1. 

l et F:7f'--fO. IJ be arn given well-behaved cdf w ith possiblv vacuous .1 containing mass 
points |t.l. m accordance with the above notation. 

I hen. F <'an be arbitarily uniiormly closelv approx'mated over except at all oj 
F's mass points a sequence of edfs wh'ch are timte fiaussian mixtures. Denote this 

relation as 


Proof. First, considei separately the truth of the theorem tor the purely linitelv discrete ease 
F = F' 'F Clearlv in this case, the sequence 




vv here 


^ i ” ^ Pj ^f.l • ii 1 " * ^jt.l • — I .n ” f( ^ ^ I ]|t.l • 


obviously, uniformly approaches F'*’ as a cdf. except over | 

Next, consider the validil.v of the theorem for the purel> absolutelv continuous case 
F = F'-’. Now. from (19), theorem 1, there exists a sequence of finite (iaussian mixtures 




:.n- hlAv -l.r 


which approaches f'-^' m I.'-norm. But using the basic absolute mequalitv relation tor ail V 'T’ 
I measurable). 

‘ I I P-'(x)dxi < 

HJn' - ’ll 

xeA xr.A 


I u. 1. P-'(X)|dx 

,,'^1 -rh2,r..n 


and letting A = A^ = iK.Kt'K' and .\<s!. for any SfTvF it follows that as cdt's, g , approaches 
F'-' uniformly over TfF 

Fmtillv, since F is a linear combinatitm of f '** and f u follows that one can let m 

eq. (.“i.b) 
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g V - A»g| + (I A)-g^ , (5.11) 

ft' ^ 

which is again a legitimate finite Gaussian mixture. 

■ 

Remark 5.1 

It should be noted that in the construction of gi above, the iip approach zero, 
a not necessarily desirable property due to the resulting fluctuatio -s of form of the pdfs. 
However, in Goodman and Boyer (1975) and in Medgyessy (1961) alternative forms can be 
utilized. Of course, in the case of g|, this cannot be acoided. 

■ 

The next theorem establishes a unique linear regression relation among any given pair 
of random vectors, provided sufficient joint second moments exist. Although this is a basic 
result, appearing in many places in one form or another [sec, e,g.. Deutsch (1965) sections ,7..7 
and ,7.4], it is surprisingly not often in the ftiil form to be given here with direct application to 
reducing nonlinear relations to "exact" linear ones, without employing approximating 
expansions. 

Theorem 5.2 

Let (fl.Ap) he a probability space and X.fl—and be random vectors 

such that Cov 

1 hen, there exists constant m by k (real) matrix B, called the regression transition 
matrix from Y to X. and random vector W-.O—such that the linear regression relation 
holds 


^ exists and Cov(X) is positive definite. 


Y BvX + W , 


(5.12, 


such that X and W are uncorrclated. W and B arc uniquely determined with 

W=Y B-X . B ^ Cov(Y,X)-Cov i(X). (5.17) 

C'ov(W) = Gov(Y) Cov(Y,X)*Cov '(X)*Cov'(Y.X) . (5.14) 

and a constant A = ffW) = E(Y) B-X), etc. can be added to the RHS of (5.12), provided W is 
replaced by the zero mean random vector W E(W). 

Proof. The result is self-evident, once equation (5.17) is noted, using the calculus of multivar¬ 
iate moments and matrices. 

■ 

Remark ‘',2. 

Note that theorem 5.2 can be applied to produce an “exact” linearization of nonlinear 
relations such as given below where X and V arc uncorrclated random vectors with E(V) = 0^ 
so that 


Y = f(X)+V, (5.15) 

where is some fixed (measurable) function, ( he result immediately follows that 

eq. (5.12) becomes here 
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Y = B-X + W , 
but where 

B = Cov[((X),X]-C(n >(X). (5.)6) 

Now. if one were to apply a standard linearization approach to the model in eq. (5.15), 
by linearizing f(X), 

f(X)-+ R^,.(X XJ, (5,17) 

v\ here 

A., ^f(.xj . B,^[df(X) dX]x=,,, • (5.18) 

for some constant t such as E(X). Substituting eq. (5.17) into eq. (5.15) yields the 
approximation 

Y-A,,+ B„.(X x,,) + V (5.19) 

.Next, if one defines the true error in eq. (5.19) as 
Z = Y Ao - B,,-(X - x„) 

= W + (B B„)-X + C. (5.20) 


where 

C-B,.x„ Ao. (5.21) 

then by the above equations and standard matrix manipulations of covariances and means 
E(Z-Z') = Cov(W) + (B B„)-Cov(X)-(B B^)^ + D-D^ 

> Cov(W) 


= Cov(V) + H 


> Cov(V) , 


(5.22) 


where 


D^E(W) + (B BJ-E(X) + C. (5.23) 

H^CovlKX)] Cov[f(X),X]-Cov '(X)-Cov^[f(X).X] . (5.24) 

.> indicates positive semidefinite partial ordering among all m by m matrices, where one has 
M I > Mt iff M I M 2 IS a positive semidefinite matrix. 
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Thus, eq. (5.22) quantitatively shows that, although one pays a penalty (H) for using 
the exactly linearized form in eqs. (5.12), and (5.16), in place of the original nonlinear additive 
form in eq. (5.15), the form is still a more accurate approach than use of the standard lineari¬ 
zation (without reiteration) m eq. (5.19). 

Finally, note that the above remarks are valid for the exact linearization of the condi¬ 
tional “signal" relation in eqs. (4.19) and (4.20). 


Corollary 5.1. 


Suppose (n,/.p) is a probability space and Xifl—Y;n—are random vectors 

such that has a well-behaved cdf over and Cov exists with Cov(X) positive 

definite. 


Then: 

(i) An exact linear regression relation holds as in eq. (5.12) between X and Y. 

(ii) For conditional random vector (Y|.X), for all outcomes y of Y and x of X, for 
sorner,,^,, I|, 


^ F(Y = y|X = x). (5.25) 

(iii) For unconditional random vector X at any possible outcome x. for some^. 


g(x) 

:2-it2-z2 


F(X = X) . 


(iv) For the marginal integrated-out cdf of Y, at any outcome y 

g (y) ^ F(y)= / F(Y = yiX = x)dF(X = X), 

k- 5 

where letting 

Ti “ • Hi ~ ■ ii ~ ■ 

i = 1.2. 

I - <-|,,| • ^2.12> I,..), • /d - ^B*F2.,|2 .l.-'i • 

-V-^1=1.2 —--^i=I,2 






d vdi,i2> 


(5.26) 


(5.27) 


(5.28) 


(5.29) 


Proof. Note that all lineai transforms on j preserve the well-behaved property. Then. 

applying theorems 5.1 and 5.2 yields (i) (iii), with (iv) obtained by multiplying out all mixture 
terms and using the well-known convolution of Gaussian pdfs which here takes the form, for 
any typical term 
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xt'K^ ' “ ^ 

■ 

Before establishing the main result, actually a corollary of the above two theorems, the 
following additional notation will be useful; 

As before, suppose Y and X are random vectors with Yifl—and X:n-'7E*‘, but 
now' where X is partitioned into 


/xA 

X = • I , X,:fl-7e‘'' , i=l,..,s, (5.31) 

\n 

where necessarily k] +■•+ k^, = k. Partition, similarly, any xt'K^ into 



and let for any i , i = 1 ... ,s. 


x(‘t = 



(5.32) 


(5.33) 


so that one notes 


X‘" = X . X*^' = X, . (5.34) 

Also, extend the notation, where 

X,A Y . X,,| =0 . X<^">'=0 , (5.35) 

etc., with similar remarks holding for x. 

Corollary 5.2. 

Suppose the hypotheses of corollary 5.1 hold, with the notation introduced in 
equations (5.31) through (5.35) valid. 

7 hen: 


(i) For each i ,i = 0,1,. .,.s, the exact linear regression relation holds 

X, = B, . + W; . (5.36) 

where XO*'* and W; are uncorrelated random vectors and each B; is a constant k; by 
k,^i +--+k,, regression transition matrix, obtained analogous to B in (5.13). Denote the parti¬ 
tioning of each B; 
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(5.37) 


BC'"') , t= l,...s i. (5.38) 

(ii) In tun, there exists finite Gaussian mixtures, where for all possible outcomes Xj 

of X, 

hrtivU^' ^ ^ f'tXi = XilXti^') = xO^')] , (5.39) 

where ^j, ^j. .§i are all formally the same as the corresponding values in eq. (5.28), except 
here, i = 0, 1,2,. ..s, noting for i = s, RHS of eq. (5.36) is identical to X^ = and, in effect, 

B^ is 0. 


(iii) Finally, the marginal, integrated-out cdf of Y, compatible with (i) and (ii), is 
uniformly approximated as, for any outcome y of Y, 


S 

g v(y) s F(y)= / F(Y = y|X = x)- II F[Xi = Xi|X('"') zx(i^‘)]dx, (5.40) 


where 


d / . d 

Z - ti- 

V_/'i=0,, .,s 


2 

i=0 




.ii«Ji. 
i=0,. .s 




= M<i> 


I d 


i=0 


ijfjj. ' Oo'• •'.i.s)eJo^’'^ J.s 
i-0,. .,s 




(5.41) 


and where 


B(0)di^ . B")dB„,| , B(2 )^Bo.2 + Bo.,-B,,2, 


- B() 3 + B() 2'B2 3 + B() [*B| 3 + Bqj^Bi 2*B2,3 
and more generally. 

Sb„, -B^^.-B, , = X B'if)*B, . 


( over all possible 
paths 0<i [<**<i(<i. 
.= 1,2... 


f=l 
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(5.42) 









Proof: (i) and (ii) follow from corollary 5.1. For (iii), consider 


F(y) = 



II F[X, = 
i=0 



^ 1 II - Bi-x(‘^')]Vdx 

Li=0 ' 

S 

J eJox..Xo;j )] . 


where 


h(xo;j;- / S gS: ;[xi - Bj • x('+>) _ ] dx 

i=o •' 

= h,(x„U;x<^^'>), 

where recursively hj is defined as follows: 

hoLxoU^xO] = gVg .^[xo - Bo-x<')-Mo.jo]. 
and for i = I,. ..s. 

h,[xo;j:x('^'i] ^ / |h,,[xo;j;x(i)].gv [X. -Bi.x(i^')_^ jl 

XjeTfki ~ '•■'i M 


(5.43) 


(5.44) 


(5.45) 


dx| . (5.46) 


Then, beginning with i = 1, one applies the identity in eq. (5.30) to obtain h|, followed 
in turn by a similar procedure for i = 2, using eq. (5.46), .... until step i = s is reached. 

I 

Remark 5.3. 

Note that the results in corollary 5.2 (iii) are equivalent to specifying a finite Gaussian 
mixture, where for each mixing index j J^, the corresponding component distribution 

is Gaussian determining a random vector, say Uj, which has E(Uj) = /ui, Cov(Uj) = 2* 

values given in eq. (5.41). In turn, from the forms in eq. (5.41), each Uj is seen to be a collec¬ 
tion of fixed linear combination of statistically independent Gaussian random vectors, say Uj f, 
where symbolically 




(5.47) 
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and each Uj f corresponds to [gv^,. (• Mr Each coefficient matrix in the linear 

combination via eq. (5.42) represents the overall regression transition matrix from Y multiplica- 
tively up to Xj via all possible distinct path combinations of individual regression transition 
matrices among pairs of random vectors from (Y,X j..X,) connecting Y to Possible 
connections may exist also with Ingber’s mesoscopic-macroscopic approach to C-^ modeling, 
where the path-integral representation relative to nonlinear, nonequilibrium Gaussian- 
Markovian statistical mechanics is used. This avenue remains to be explored. [Again, see 
Ingber (1986).] 

■ 

Remark 5.4. 

In applying corollary 5.2. the philosophy of approach is as follows: One does not know 
a priori the distribution of Y, the desired goal, but one does know — or has control in assign¬ 
ing — all of the intermediate or auxiliary conditional distributions, conditioning Y on X. X| 

on X<- 1 , Xt on X*-^*.and finally X^ being trivialized to make X^ an unconditional 

random vector]. Further help in reducing calculations in eqs. (5.41) and (5.42) will occur if 
sufficiency or Markovian-like assumptions can be made, thereby causing in effect a number of 
individual transition matrices Bj^ to be zero. 

In particular, consider now applying corollary 5.2 to the evolution of node states as in 
steps (i) and (ii), sections 3 and 4, where ALDP=PL: 


Y = Xo=N"* = (#WP|", #WP 2 *. #WP/. #TROOP^ E0MO\ INFO*) . (5.48) 

X= • . s = 21 (5.49) 

\xnj 


where, replacing directly N. and hence N*, as well as T". by their component subvariables, as 
given in eqs. (3.3) and (3.4), 

X| = R**, (5.50) 

X 2 = DEC*. X 3 = CONS*. X 4 = FU,S*, X 5 = HYP*. Xf, = AEG*. X-, = DET* . (5.51) 


Xh =#WP|*. X 9 =#WP 2 * X |0 = #WP 3 * , 

X||^ ffTROOP*. X [2 = EQMO*. X,^ = INFO* . (5.52) 

X |4 = S. (5.53) 

X |5 = R (5.54) 

X|ft = »WP|. X |7 = ffWPj, X|x = nwpy 

X |9 = #TROOP. X 20 - EQMO. Xt, = INFO . (5.55) 
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In turn, due to the assumptions in table 2, a number of transition matrices can be set 
equal to zero, as mentioned earlier; 


^0.1 - 

i=2 ... 

.,7 ,14 ,..,21 

B|,, . 

i=3 ,. 

.,7 ,14 ,. .,21 

\^2. 

i,-2 , 

II 

Bi,I5 ■ 

. i=8 .. 

.,13 , 

B|4,i ■ 

. i=16 

,... 21 


(5.56) 


Thus, the key calculaticns in equations (4.12), (4.13), and (4.16) through (4.19) can all 
be replaced, using eqs. (5.48) through (5.56) in corollary 5.2 (iii). 

If one considers the number of operations required in eqs. (4.12), (4.13) and (4.16) 
through (4.19) directly to compute p(N**^), assuming equally sized domains of values, say q (as 
noted at the end of section 4), one obtains here on the order of q^’, 21 being the number of 
variables being integrated out in eq. (4.1). On the other hand, the linear-Gaussian mixture 
approximation of corollary 5.2 (iii) requires about card(Jo)^* mixing coefficients, when card(Jj) 
= card (Jq), for all i. In addition, for each mixture distribution corresponding to a mixing term, 
there are 2 x 22 + 3 x 22 entire matrix multiplication and addition operations for obtaining 
the characterizing Gaussian parameters; the mean and covariance matrix. There is also an 
upper bound of 2^' — reduced by used of eq. (5.56) — number of matrix additions of matrix 
multiplication required to obtain recursively, as in eq. (5.42). Hence, for the 

linear-Gaussian approach, a multiplicative value of [2card(Jo)]2’ could be required for 
implementation. 

Thus, if the average number of mixing coefficients can be reduced so that 


card(Jo) ^ q/2 , (5.57) 

then the linear-Gaussian mixture approach can be of real use. This will occur especially when 
the number of C-^ variables describable by single-Gaussian distributions or by some absolutely 
continuous distributions which are bimodal or at least relatively minimum in number of 
modes. This is opposite in kind to the situation where most variables are discrete with the 
only good Gaussian mixture approximations being essentially the same as the original discrete 
distributions, but with each corresponding dirac delta function replaced by a Gaussian distribu¬ 
tion of sufficiently small covariance matrix, as in the proof of theorem 5.1. In the latter case, 
eq. (5.57) will be violated and the better approach is to stay with the original integrals, possibly 
discretizing them. 

■ 

One desirable property of Gaussian mixtures is the ease in computing means and 
covariance matrices, once the mixing parameters are all determined. Thus, it follows easily that 
for Y in corollary 5.2 

E(Y) « X , (5.58) 

jtJoX*«x 
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Cov(Y) ® X ( ^ - E(Y)]-[M<i) - E(Y)]T ) . 

^Jqx-.xJ^ 


(5.59) 


Finally, mention must be made of another possible source of difficulty in implementing 
the linear-Gaussian mixture method. This involves the actual construction of the Gaussian 
mixtures, mentioned previously, [Again, see Goodman and Boyer (1975) and Medgyessy (1961) 
for techniques.] 


6. CONCLUSIONS 

To implement the proposed general C-^ decision game, as outlined in the previous 
sections, for a given simulated scenario, one must be careful in defining the boundaries for 
what constitutes the relevant C-^ variables. This is a relative concept. In a given situation, a 
node may represent simply a single person or machine, such as a tank crew, or it may represent 
an entire group of tanks, depending on the desired aggregation or hierarchical level considered. 
In addition, before implementing the model proposed here, one must scope out what consti¬ 
tutes a “signal" input-output node cycle and over what time periods the “signals” occur. 

Consider, for example, the following possible simplified inner-outer air battle: 

(1) Enemy bombers (I) arrive in formation towards grouping of friendly ships of two 
types (IV,V). 

(2) Friendly scout airplanes (II) detect/surveil 1 and pass information to friendly 
fighter airplanes (111) as well as to IV,V. 

(3) 111 meet I and attack, 1 being passive, 

(4) Remaining I continue toward IV,V, with 111 now ceasing attacks. 

(5) IV.V send missiles against remaining I, before themselves are bombed by 1. 

(6) Remaining 1, following now above missile attack, bomb 1V,V. 

(7) End of scenario as 1 turns away. 

For an outline of approach, the aggregation level here is to make each individual 
combatant a distinct node. Thus, there are five types of nodes here; enemy bombers (I), 
friendly surveillance airplanes (II), friendly fighter planes (III), friendly ships of types (IV) and 
(V). Within each type, one can designate individual nodes by suitable indexing. In addition, 
one must determine for each side, friendly or adversary, all of the relative primitive relations 
such as given in eq. (4.21) in probability form. All of these will also depend on what constitute 
node cycles. Based on this scenario, table 4 presents a tentative collection of epochs of node 
interaction which can be identified as input-output node-processing cycles. 

Future efforts will be directed toward further implementation of the C-^ decision game 
relative to particular scenarios such as the inner-outer air battle. 
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Table 4. Categori?alion of events occurring during inner-outer air battle. 


Node 


Type 


Input-output node cycles occur at phase changes which are by doctrine and game design 


1: Enemy 
Bombers 

Initial 

1 

BFA by 111 
BFA by IV 
BFA by V 

1 - 

BFA by HI 
BFA by IV 
BFA by V 

BFA^ by 111 
BFA^ by IV 
BFA* by V 

BOMB IV 
BOMB V 

1 

BOMB IV 
BOMB V 

BOMB* IV 
BOMB* V 

End 

II: Friend 
Surv. 

Initial 

! 

SPOT I 

SPOT 1 

SPOT* 1 

SINF HI 
SINF IV 

SINFV 

End 


Ill; Friend 
Fight 

Initial 

RINF 

from 11 

RINF 

from II 

_ j 

1 

RINF* 
from II 

FIR at 1 

FIR at 1 

FIR* at 1 

End 

IV: Friend 

Ship 

Initial 

RINF 
from 11 

! 

RINF 
from 11 

i 

FIR : 

1 

at 1 

FIR 
at 1 

FIR* 
at I 

BBOM 
by I 

BBOM 
by 1 

BBOM* 
by 1 

End 

V: Friend 
Ship 

Initial 

RINF 

from II 

RINF 
from 11 

_i 

FIR 
at I 

FIR 
at 1 

1 

FIR^ 
at 1 

BBOM 
by 1 

BBOM 
by I 

BBOM* 
by 1 

L 

End 


y 


Symbols: BFA = Being Fired At . SPOT = Spotting , SINF = Sending Information 
RINF = Receiving Information , FIR = firing , BBOM = Being Bombed . 
BOM = Bombing . ( ) = Just Before , ( )* = Just After 


EACH ROW LISTS EVENTS IN SEQUENCE OF OCCURRENCE. COLUMNS ARE NOT RELATED TO 
SUCH OCCURRENCES. 
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